<AfiY 

{NIC AL REPORT SECTION 
-AL POSTGRADUATE SCHOOL 
JTEREY, CALIFORNIA 93940 



NPS55-80-0 

NAVAL 



POSTGRADUATE SCHOOL 

Monterey, California 




NEW AUTOREGRESSIVE TIME SERIES MODEL 
IN EXPONENTIAL VARIABLES 
(NEAR ( 1) ) 

by 

A. J. Lawrance 
and 

P. A. W. Lewis 
March 1980 

Approved for public release; distribution unlimited. 

Prepared for: 

tstgraduate School 
Ca. 93940 



FEDDOCS 

D 208.1 4/2:NPS-55-80-011 



-I- POSTGRADUATE school 

MONTEREY , CALIFORNIA 



** ear Admiral T. f. 

Superintendent 



Dsdman 



J « R. Worsting 
Provost 



This 



report was prepared by: 




UNCLASSIFIED 

SECURITY CLASSIFICATION OF THIS PAGE (When Date Entered) 



REPORT DOCUMENTATION PAGE 


READ INSTRUCTIONS 
BEFORE COMPLETING FORM 


1. REPORT NUMBER 2. GOVT ACCESSION NO. 

NPS55-80-011 


3. RECIPIENT'S CATALOG NUMBER 


4. TITLE (end Subtitte) 

A New Autoregressive Time Series Model in 
Exponential Variables (NEAR(l) ) 


S. TYPE OF REPORT 4 PERIOD COVERED 

Technical 


6. PERFORMING ORG. REPORT NUMBER 


7. author^) 

A, J. Lawrance and P. A. W. Lewis 


8. CONTRACT OR GRANT NUMBER (s) 


9. PERFORMING ORGANIZATION NAME AND ADDRESS 

Naval Postgraduate School 
Monterey, CA 93940 


10. PROGRAM ELEMENT. PROJECT, TASK 
AREA 4 WORK UNIT NUMBERS 

61152N, RR000-01-10 
NO 0 0 14 8 0WR000 5 4 


11. CONTROLLING OFFICE NAME AND ADDRESS 

Naval Postgraduate School 
Monterey, CA 93940 


12 REPORT DATE 

March 1989 


13. NUMBER OF PAGES 

39 


T4 MONITORING AGENCY name 4 ADDRESS^// different from Controlling Ottlce) 


IS SECURITY CLASS (ot this report) 

Unclassified 


ISa. DECLASSI FI CATION /DOWN GRADING 
SCHEDULE 


16. DISTRIBUTION STATEMENT (of thl a Report) 

Approved for public release; distribution unlimited. 


17. DISTRIBUTION STATEMENT (of the abstract entered In Bfock 20, If different from Report) 


18. supplementary NOTES 


19. KEY WORDS (Continue on reverse side If necessary and Identify by block number) 

Autoregressive model in exponential variables; Negative correlation; Cross- 
coupled processes; Antithetic variables; Correlated uniform process; 

Time series; Point process; Simulation. 


20. ABSTRACT (Continue on reverse side If necessary and Identify by block number) 

A new time series model for exponential variables having first order auto- 
regressive structure is presented. Unlike the recently studied standard 
autoregressive model in exponential variables (EAR ( 1 ) ) , runs of constantly 
scaled values are avoidable, and the two parameter structure allows some 
adjustment of time nonreversibility effects in sample path behavior. The 
model is further developed by the use of cross-coupling and antithetic 
ideas to allow negative dependency. Joint distributions and autocorrelations 



DD 1 j AN^S 1473 EDITION OF 1 NOV 6S IS OBSOLETE 
S/N 0102-014- 6601 | 



UNCLASSIFIED 



SECURITY CLASSIFICATION OF THIS PAGE Dete Entered) 



UNCLASSIFIED 



J.CURITY CLASSIFICATION OF THIS PAQEfHW Dmt. E^Zd) 

20. Abstract Cont. 



are investigated, 
marginal distributi 
are also obtained, 
considered. 



A transformed version of the model has a uniform 

0 LX a ilL C Z rel : ti0n , 3nd rS ^ essi - structures 
Estimation aspects of the models are briefly 



SECURITY CLASSIFICATION 



OF THIS PAGE(T*T..n D.f. Enltr.d) 



I 



A NEW AUTOREGRESSIVE TIME SERIES MODEL 
IN EXPONENTIAL VARIABLES 
(NEAR(l) ) 

by 

A. J. Lawrance and 

University of Birmingham 
Birmingham, England 

SUMMARY 

A new time series model for exponential variables having first 
order autoregressive structure is presented. Unlike the recently studied 
standard autoregressive model in exponential variables (EAR(l)), runs of con- 
stantly scaled values are avoidable, and the two parameter structure allows some 
adjustment of time nonreversibility effects in sample path behavior. The 
model is further developed by the use of cross-coupling and antithetic 
ideas to allow negative dependency. Joint distributions and autocorrelations 
are investigated. A transformed version of the model has a uniform marginal 
distribution and its correlation and regression structures are also obtained. 
Estimation aspects of the models are briefly considered. 

KEYWORDS: Autoregressive model in exponential variables; Negative correlation; 

Cross-coupled processes; Antithetic variables; Correlated uniform 
process: Time series; Point process; Simulation. 



P. A. W. Lewis 

Naval Postgraduate School 
Monterey , California 



1 . INTRODUCTION 



In this paper we begin by introducting a new two-parameter model, 
to be called NEAR(l), first mentioned in Lawrance (1979), for a first-order 
autoregressive time series with exponentially distributed marginals. The 
model is a first-order Markov process. Suitably choosing one of the 
parameters as a function of the other produces a one-parameter first- 
order autoregressive process which can give any value of the lag one 
autocorrelation between zero and one. One particular model produced in 
this way is the EAR(l) model introduced by Gaver and Lewis (1980) ; this 
model had the problem that a M zero-defect” caused successive values of 
the process to be, at times, fixed multiples of the previous values. The 
NEAR(l) model does not have this defect except for the EAR(l) special case 
and thus seems much more suitable than the EAR(l) model for the modelling 
of real data. In addition, the fact that there are two parameters 
indexing the dependency structure of the model allows one to consider 
sample path behavior as well as the customary fitting of the first and 
second order moments to the data. The model is defined in Section 2. 

At another extreme from the EAR(l) model, a one-parameter model 
(TEAR(l)) is produced which is much easier to extend to higher order 
autoregressive structures than is the EAR(l) model (Lawrance and Lewis, 
1980) . However while it has no zero defect, this TEAR(l) model produces 
realizations which, for high serial correlation, tend to run up most of 
the time; for the general NEAR(l) model these aspects can be adjusted. 

A one-parameter model which can mimic some of the time-reversible char- 
acter of normal AR(1) processes is produced from the NEAR(l) model by 
requiring either that the probability of a jump up from one value to 
the next be one-half or requiring that the first directional moments be 
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equal. A property which the NEAR(l) model does not share with its special 
EAR(l) case is additivity, so that extensions to Gamma marginals are not 
automatic; other marginal distributions are possible with the NEAR(l) 
structure but these are not discussed here. 

An important property of the NEAR(l) models is that they are simple 
random linear combinations of independent exponential variables and there- 
fore easy to simulate. This simplicity is bought at the price of auto- 
correlations which are nonnegative. 

The second thrust of the paper concerns alternation and negativity 
of autocorrelations; this will be achieved by a scheme coupling two antithetic 
NEAR(l) sequences, a scheme introduced by Gaver and Lewis (1980) for the negatively 
correlated EAR(l) process. The resulting model, to be called the NEARA(l) , 
includes both the NEAR(l) and hence TEAR(l) as special cases; it has auto- 
correlations which alternate into negativity under a geometrically decaying 
envelope. However, simulation of the negatively dependent models involves 
random linear combinations from independent pairs of negatively dependent 
exponential variables, and this can be complicated. Most developments in 
the paper are undertaken for the general NEARA(l) model, and further detail- 
ing of results are given separately for the positive and negative dependency 
cases. In particular, the paper deals with the allowable range of lag one 
autocorrelations, lag r bivariate distributions, exponentiation of the 
models to have uniform marginal distribution, and aspects of time reversi- 
bility, sample path behavior and estimation. 

Simulation aspects of the models are discussed in Lawrance and Lewis 
(1980); detailed graphical representations of different sample path 
behaviors are also given there* 
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2. CONSTRUCTION OF THE MODELS 

The conventional linear autoregressive model (AR(1)) with exponential (X) 
marginal distributions (Gaver and Lewis, 1980) takes the form 



0 w.p . p 



X 

n 



pX + 

n-1 



n = 0,1,2, . . . , (2.1) 



E^ w.p. 1-p 

where p is a parameter (0 _< p < 1) and the E^, n = 0,1,2,... are inde- 
pendent exponential variables with parameter X >0. This EAR(l) model has 
serial correlations of order r, p^ = corr (X^,X^ + ^) , given by p and gen- 

erates sample paths in which large values are followed by runs of falling 
values with geometrically distributed run-length. The large values arise 

when E is included, while the falling values stem from the selection in 
n 

(2.1) giving only X = pX . This behavior is likely to limit the broad 

n n~l 

applicability of the model, although it can be overcome the more complicated 
moving-average and mixed moving average-autoregressive developments (Lawrance 

and Lewis, 1977, 1980a; Jacobs and Lewis, 1977). 

An alternative exponential first-order autoregressive Markov 
model is obtained by interchanging the independent and identically distri- 
buted variables X - and E in (2.1); this can have no effect on the 

n-1 n 

exponential(X) marginal distribution of X f s. Proceeding this way, with 
p replaced by 1-a , we have the model 



X 

n 



(l-a)E +) 
n 



X _ w .p . a 
n-1 

n 

0 w.p. 1-a 



0.k,2, . . . 



( 2 . 2 ) 



This exponential AR(1) model, called TEAR(l) , is again Markovian and has 

X 

the a correlation structure of the EAR(l) model; it is, as will be shown 
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later, particularly tractable analytically. The characteristic behavior of 

realizations generated by this model (particularly distinct when a is 

large) is that of runs of rising values (with geometrically distributed 

run length) when the selection (1-cOE^ + is being made, followed by 

a sharp fall when the selection (l-a)E is made without inclusion of the 

n 

previous value. Illustrations of these effects both for the EAR(l) and 
TEAR(l) models are given in the simulations of Fig. la and Fig. lb. These 
simulated sample paths use the same simulated exponential error sequence 

f E ) . 

n 

Broader behavior in realizations generated by an exponential model 

can be obtained from the model in which the X _ of (2.2) is scaled by 

n-1 

a coefficient B. This gives the proposed NEAR(l) model (Lawrance, 1980) 



as 



X 

n 



e + 

n 



BX 



n-1 



w .p . a 



w.p. 1-a 



n = 0,1,2, 



(2.3) 



where the existence and distribution of the i.i.d. {e^} sequence which 

makes the X ' s in the stationary case have exponential(A) distributions, 

needs to be established afresh. We now show that e must have a 

n 

particular mixed exponential distribution. 

Let the Laplace-S tielt jes transforms of the X and e variables 
be denoted by 

<J> x (s) = E(e -bX } and <J> £ (s) = E{e~ Se } . (2.4) 



Then (2.3) gives, if we assume stationarity , 
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(2.5) 



on using 
to one, 



a<f> (8s) + (1-a) X 4- s 
x 

(p v (s) = X/ (X + s) . Thus, providing 
X 

e^ can be generated from an by 



X 

X + (l-a)3s * 

a and 3 are not both equal 
the exponential mixture 



£ 

n 



E 

n 

< 



(l-a)BE 

n 



1 - 3 

W ' P " 1 - (1-a) 8 

aB 

w ' p ' i - (i-coe 



n = 0,1,... 



( 2 . 6 ) 



When a = 0 or 3 = 0 the {X^} are exponential i.i.d., whereas with 

a = 1 the EAR(l) model (2.1) is obtained with p^ = 3. When 3=1 the 

TEAR(l) model is obtained. Thus the two-parameter exponential, first-order, 

autoregressive Markov NEAR(l) model can be expected, for fixed serial 

correlation of lag 1, = a3, to model broader behavior than is obtained 

in the extreme cases (a = 1 or 3=1). In particular a and 3 can be 

chosen to produce both runs of ascending and descending values, intermediate 

to the profiles of EAR(l) and TEAR(l) models, as was illustrated in Fig. la 

or Fig. lb. Figure lc represents an intermediate case which will be discussed 

in Section 8. Note that the correlation is the same, 0.75, in all three figures. 

It is also clear from the Markovian nature of the model (i.e. that 

conditional on X _ = x the distribution of subsequent values 

n-1 n-1 

X , X , _ , ... is independent of X X ~, ...), that if X. is 

n n+1 r n-2 n-3 0 

exponential(X) and independent of E , E^, ... , then the process X^, 

n = 1,2,... is stationary. Note too that the NEAR(l) model is, by 

definition, explicitly (physically) autoregressive and thus not only auto- 

regeressive in the sense that E(X |x - = x) is a linear function of x. 

n n-1 
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We note too 



that the NEAR(l) model gives a 



solution to the (random) 



stochastic difference equation 

x = A X - + B , n = 0,1,2, .. . 

n n n-1 n 



(2.7) 



discussed by Vervaat (1979) in which A^ = B w.p. a and = 0 w.p. (1-ct): 

Vervaat's paper discusses questions of existence and infinite divisibility 



applying to the model (2.7). 



In the NEAR(l) model the parameters a and B are nonnegative. 
Therefore the autocorrelations = (aB) are positive and geometrically 

decreasing. This is unlike the standard AR(1) model with, say, normal 
marginals, where can be negative, so that the autocorrelations can 

alternate between positive and negative values with a geometrically 
decreasing envelope. To extend the exponential models to the situation where 
there is a possibility of alternation in the autocorrelations and negative 
correlation requires some sacrifice of simplicity. As noted in Section 1, 
the primary idea here is to cross -couple two sequences { and { X^} 
with identically exponentially distributed marginal distributions across 
an independent bivariate sequence (e^, 0 f negatively correlated 

and marginally identical variables. This final development produces our 
so-called NEARA(l) model; it is specified by the equations 



X 

n 



e 

n 



+ BV X 1 
n n- 



1 ’ 



X ? = e T + B V 1 X , , 
n n n n-1 



V 

n 



V 1 

n 



1 

0 

1 

0 



w.p. a 
w.p. 1-a, 



w.p. a 
w.p. 1-a 



n 



0 , 1 , 2 ,... ( 2 . 8 ) 
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where the serially independent binary pairs and generally have 

negative dependency. Some insight into the model comes from seeing that 

is positively dependent on X^_^; this is negatively dependent on x n _i> 
so making and negatively dependent. Though defined compactly 

in terms of the two processes, the interest here is in the marginal process 
X . A univariate description of X^ is possible and given at equation 
(3.2). 

The special case of the bivariate sequences (e , e 1 } and (V , V 1 } 

n n n n 

in which e = e 1 and V = V 1 recovers the NEAR(l) model. The special 
n n n n 

case when 3 = 1 will be called the TEARA(l) model. 

Detailed aspects of the sequence {X^} depend on the joint distri- 
butions of {c , c 1 } and {V , V 1 }, though the marginal distributions of 
n n n n 

and must be as at (2.6) for X^ to be marginally exponential. For 

instance for the TEARA(l) model, strongest alternation in serial correlations 
is obtained when the (e^, eM are maximally negatively correlated expo- 
nential variables and therefore are antithetic pairs, and similarly for 
the binary pairs { V^, V^} . For the broader NEARA(l) model, (2.8), 
negatively correlated mixed exponential variables (c^, e ^ are required. 
Some of these aspects of the model are explored in general and for specific 

(e , c 1 } and {V , V 1 } distributions in Sections 4 and 5. In this 
n n n n 

respect this paper extends results and details for the negatively correlated 

EAR(l) model given by Gaver and Lewis (1980) . 

Note that while {X , X 1 } is a bivariate Markovian model, the 

n n 

full Markovian property of X^ individually is lost unless it reduces to 
the NEAR(l) model; that is to be expected from the cross-dependency built 
into the model. 
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3. AUTOCORRELATION STRUCTURE OF THE MODEL 

The simple autocorrelation structure of the NEARA(l) model, as 
given at (2.8) by 



X 

n 



e 

n 



8V X f 1 
n n-1 



X f 
n 



e f + 
n 



8V f X 
n n- 



1 



(3.1) 



is best approached by recursively expressing the dependency of X^ on 

either X f _ , X 0 , X 1 0 , X and so on. Directly from (3.1) it 

n-1 n-Z n-d n-<4 

can be noted that the distribution of ^ X n ,X n _i^ s i m Ply expressed in 

terms of the distribution of (X _,X f ): in fact, this latter joint 

n— 1 n— 1 

distribution, equivalently (X^,X^) , plays a central role in the process. 

However, substituting for X f _ in the first equation (3.1) from the 

n-1 

second, gives 



X = e + BV e' + bV ,V X . . 
n n n n-1 n-1 n n-2 



(3.2) 



Hence the joint distribution of (X ,X „) does not need to be expressed 

n n-Z 

in terras of (X^,X^) an< * t ^ 1 ^ s ver Y convenient. Generally, there is this 

distinction between the odd-r and even-r cases of (X ,X ) . This is shown 

n n-r 

in the following key expressions which are obtained by repeated substitutions 



X = e + BV e' + S 2 V' V e . + ••• + (g r V _ 

n n n n-1 n-1 n n-2 n-r+2 



V' _e , ) 
n-1 n-r+1 



+ (3 r V 



n-r+1 



V f V X f ); 
n-1 n n-r 



(r odd) 



(3.3) 



X = e +8Ve'+B 2 V'Ve 0 + 
n n n n-1 n-1 n n-2 



+ (B r 1 V 



n 



-r+2 



V' V e' 

n-1 n n-r+1 



) 



+cbV .. 

n-r+1 



V f V X ) . 
n-1 n n-r 



(r even) 



(3.4) 
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The autocovariances of {X^} follow easily from (3.3) and (3.4). On 
noting that the indicator variables {V^} occur independently in the 
products, we have 

E ( V ' , •• • V' V ) = a r 

n-r+1 n-1 n 

and hence 



(3.5) 





r x* 

(aB) Var(X ) 

n-r 


(r 


even) 


Cov(X ,X ) = ' 

n n-r 


(aB) r Cov(X ,X' 

n-r n 


) (r 

-r 


odd) . 


terms of correlations, this central 


result becomes 




(aB) r 


(r 


even) 


Corr(X ,X ) = 

n n-r 


i 

(aB) r Corr (X ,X') 
n n 


(r 


odd) . 



(3.6) 



(3.7) 



Alternation of these autocorrelations under a geometric envelope is evident 

negativity of the odd lag correlations requires the negativity of 

Corr(X , X f ) . For the simpler NEAR(l) model in which X = X f the Markov 
n n n n 

■j* 

(aB) correlation structure is evident. 

For the NEARA(l) , an investigation of Corr(X^,X^) is required. 

To this end, multiply together the respective sides of the two equations 
(3.1), giving 



X X' = e e' + BV'e X , + BV e'X' , + M V'X ,X' , 
n n n n n n n-1 n n n-1 n n n-1 n-1 



(3.8) 



and take expectations. Let 



€ = Cov(e , e f ) 
n n 



and 



v = Cov( V ,V f ) 
n n 



(3.9) 



and assume stationarity . Then following from (3.8) there is the result 



Corr (X ,X') = (€ + B 2 v)/(1 - (a 2 + v)g 2 }. (3.10) 

n n 

The important conclusion is that maximum negativity of Corr(X ,X f ) is 

n n 

obtained, for any fixed values of a and 3, for maximum negative correla- 
tions within the pairs (e ,e f ) and (V , V 1 ). The proof is omitted, 

n n n n 

Obtaining this maximum negative correlation by the use of antithetic 
variables is developed in the next section. 



4. ANTITHETIC ASPECTS OF THE MODEL. 

It is simplest to deal first with the binary (V ,V f ) variables: 

n n 

the basic antithetic idea is to relate the distribution of V to a 

n 

monotonic transformation of a uniform variable U on (0,1); then V 1 

n 

is the same transformation of 1 - U which also has a (0,1) uniform 
distribution. The variables and are then maximally negatively 

correlated. Thus, we define 



V 

n 


= i 


if 


U < a 
n — 




V' = 1 
n 


if 


1-U 

n 


< a or 


U 

n 


2 


l-a 


V 

n 


= 0 


if 


U > a . 

n 




V' = 0 
n 


if 


1-U 

n 


> a or 


U 

n 


< 


1-a 



The resulting joint distribution takes one of two forms, as given below, 
depending on whether a < 1/2 or a > 1/2: 
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V = 
n 


i 


0 


V' 

n 


V' = 1 
n 


0 


a 


a 


0 


a 


l-2a 


1-a 


V 

n 


a 


1-a 


i 



(a < 1/2) 



< 

3 

II 


1 


0 


V ' 
n 


V’ = 1 
n 


2a- 1 


1-a 


a 


0 


1-a 


0 


1-a 


V 

n 


a 


1-a 


i 



(a > 1/2) 



(4.1) 



The resulting covariances are v = -a for 0 _< a _< 1/2 and v = (1-a) 
for 1/2 _< a < 1; the corresponding correlations are thus -a/(l-a) if 
0 < a < 1/2 and -(l-a)/a if 1/2 a < 1. The a = 1 case is exceptional 
and is excluded since it leads to the negatively correlated EAR(l) model 
treated in Gaver and Lewis (1980) . 

Next we consider how to obtain a bivariate mixed exponential dis- 
tribution for (e ,e^) having maximum negative dependency. In the case 
of positive continuous random variables, the maximum negative correlation 
is obtained by the antithetic pair (Moran, 1967) . However, with (e^,e^) 
having mixed exponential marginals, the full antithetic distributions 
cannot be obtained explicitly since the inverse distribution function F ^(*) 
cannot be obtained explicitly. An alternative way of obtaining negatively 
correlated ( e n > 6: ^ begins by noting that 

e = K E and £ 1 = K f E f (4.2) 

n n n n n n 

where marginally, from (2.6), 
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1 



w.p. (1-B) /{l-(l-a)B) 



K , K' = 
n n 



(4.3) 



(l-a)B w.p. aB/{l-(l-a)B) 



and E , E' are exponential (X) variables, marginally. The dependency of 
n n 

e and e ' is then given by 
n n 



Cov(£ ,e ' ) = (X -2 + C )C + [E(K)] 2 C_ , 
n n L iii 



(4.4) 



where C Tr is the covariance of K and K f and C is the covariance 

of E^ and E^. Although any negatively correlated bivariate exponential 

can be used for (E,E*), the most negative correlation is attained in the 

(degenerate) antithetic case. The antithetic choice for (K ,K f ), whose 

n n 

distribution follows (4.1) with a replaced by (1-3 ) /{ l-( l-a)6 ) > does 

not involve degeneracy. These antithetic choices should give a negatively 

correlated mixed exponential pair (e ,e f ) whose correlation is almost 

n n 

as negative as the true antithetic bivariate mixed exponential pair. 

Note that the distribution of this bivariate mixed exponential pair 

(e ,e T ) is a little complicated in view of the break in form of the 
n n 

antithetic distribution of the binary pair (K ,K f ) at (1-6) /{ l-(l-a)B } = 1/2 

n n 

or 3 = l/(l+a). Covariance calculations using (4.4) then give the result 

(l-2aB) (I-tt^/6) - (aB) 2 for 3 < l/(l+a) 

(4.5) 

(l-a)6 (2-a3-B) (1 -tt^/ 6)-(1-B) 2 for 3 > l/(l+a). 



X ^Cov(e ,e f ) = 

n n 
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This expression will now be used in determining explicit results for the 
first autocorrelation of the NEARA(l) model. Other less degenerate 
negatively correlated exponential random variables can be used; the 
simplest and most easily utilized one is given by Gaver (1972). 



5. THE FIRST AUTOCORRELATION 



The first autocorrelation of the NEARA(l) model can now be obtained, 

and its range of values will be determined, both generally and in the 

3=1 case, the so-called TEARA(l) model. Interest is in the degree to 

which negativity can be attained, bearing in mind that with exponential 

2 

marginal distributions there is a theoretical lower bound of ( 1— rr /6) =-0.6449 
on the correlation. From (3.7), (3.10) and (4.1) we have 

' 3 

aB^-(aB) for 0 < a < 1/2 



p = Corr (X , X . ) 
1 n n— l 



(5.1) 

aB { (1-a) 2 B 2 } / { l-(2a-l)B 2 ) for 1/2 < a < 1. 



This result is combined with € from (4.5) to give the most general 
expression 



p i 



aB(l-2ctB) (l-TT 2 /6)-2(a8 ) 1 0 1 a i !/ 2 > $ < 1/d+a) 

aB 2 (l-a) (2-aB-B)(l-ir 2 /6)-aB(l-B) 2 -(aB) 3 , 0 £ a £ 1/2, B >l/(l4a) 

■ {aB(l-2aB)(l-r 2 /6)-(aB) 3 -a(l-a) 2 B 3 }/{l-(2a-l)B 2 } (5.2) 

1/2 £ a < 1, B < 1/ (1+a) 

(a(l-a)B 2 (2-aB~B) (1-tt 2 /6) -aB (1-B ) 2 -a( 1-a) 2 B 3 } /{ l-( 2a-l)B 2 ) 

1/2 < a < 1, B > l/(l+a) . 
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It is worth stressing that the negativity of p implies the 

negativity of Corr(X ,X ! ); then by virtue of the general result (3.7) 

n n 

there is strong alternation in the autocorrelations which parallels the 

-j-* 

usual Markov correlation structure when is negative. However, 

in general the marginal NEARA(l) process is not a first-order Markov 
process . 



6. THE LAG ONE JOINT DISTRIBUTION 

Following on from the first autocorrelation, the full joint distri- 
bution of (X ,X . ) is of interest in describing the process and match- 
n n-1 

ing it with data. This joint distribution can be obtained from the NEARA(l) 
model equations (2.8) with the use of Laplace-Stieltjes transforms; thus 

<j> v (s , t ) = E{exp(-SX - tX _)} (6.1) 

X , X r n n-1 

n n-1 

= E{exp [-s (e + BV X' J - tX 1} 
r n n n-1 n-1 

= E{exp(-se - tX - BsV X 1 ,)}. (6.2) 

n n-1 n n-1 

Writing cj) (s) for E(exp(-sc )} and taking expectations with respect 
n 

to V , we have 
n 

4> x X = 4> £ (s){a^ x x i(t,Bs) + (1— ot)4> x (t) } . (6.3) 

n* n-1 

The suffix n has been dropped from the right-hand side of (6.3) in view 
of the stationary assumption; again the joint distribution of (X,X ! ) is 
required. However, when the simpler NEAR(l) model allowing only positive 
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dependency is considered so that formally X = X f , there is the simpler 
result 

^ ^ (s,t) = (j) (s) {a(f)^(g s + t) + (1-a) (J)^(t)}. (6.4) 

n’ n-1 £ 

where $ (t) = X/(X+t) . This can be inverted but the overall behavior 

X 

can be seen immediately. With probability 1-a there is a scatter of 

values X = £ independent of the X variable, where as with prob- 

n n n-1 F 

ability a, X = e + BX .. and is always above the line X = 8X 

n n n-i n n-1 

Returning now to the NEARA(l) model, the joint distribution of 

(X,X f ) is required. By constructing Laplace-Stielt j es transforms from 

each side of the model equations (2.8), it follows that 



■ Y ,(s,t) = E(exp[-s(e + B V X ' ) - t (e ' + $V'X ) ]} 

X , X r n n n-1 n n n-1 

n n 



_ , (s, t) E{exp(-Btv'x - BSV X' ) 
,£ n n-1 n n-1 



} • 



(6.5) 



Now the joint distribution of (V ,V') is available from (4.1) and so 

n n 



1 (s » t) 
n’ n 



= , (s, t) 



1 - 2a + a<(> x (3s) + a<f> x (Bt), 



0 < a < 1/2 



( 6 . 6 ) 



(2a-l) x , (Bt.Bs) + (1-a) <J> x (Bs) + (1-a) <fr (Bt) 
n-1’ n-1 



1/2 < a < 1 . 



It is seen that, for 0 _< a _< 1/2, <p ,(s,t) is immediately available 

X , X 
n n 

in terms of <J> f (s,t) whereas for 1/2 < a < 1 a recursive calculation 

£ , £ 
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is required. This simplifies somewhat if it can be assumed that the joint 



distribution of (e,e f ) and hence the joint distribution of (X ,X f ) are 

n n 

symmetric in s and t; there would be no point in assuming otherwise for 

univariate modelling of (X }. A certain amount of calculation then gives 

n 

the final form of (6.6) as 



<f> (s,t) = 

X ,X f 
n n 



[ (l-2a) + a{<t> (Bs) + <f> (Bt)}]<|> f (s,t), 0<^a_<l/2 

A A £ y £ 



(6.7) 



(1-a) l (2a-l) J U (B J s) + <f> (B J t) ] II A _ 
j=0 X X i=0 € ’ £ 



,(B 1 s,e 1 t), 



1/2 <_ ct < 1. 

The series here can be summed in the 8 = 1, TEARA(l) case when the joint 
distribution of (e,e f ) is a bivariate exponential. In the NEARA(l) case, 
the bivariate distribution which has been proposed at (4.2) gives 



|> ,(s,t) = E{exp(-sK E - tK'E’)} 

e ,e n n n n 



( 6 . 8 ) 



and this can be expressed in terms of the joint Laplace-Stielt j es transform 

A ,(s,t) of the underlying bivariate exponentials. Thus 

E , E 

*e t e l(8tt) = 2 l-(l-o) ~ B { * E ,E» (s » (1_a)Bt) + ^E ,E' ( O-0t)8s , t) } 

1 - 6 



+ 1-2 



in 1 p , ( (l-a)Bs , (l-a)gt) , 

l-(l-a)B \ E,E 



(6.9) 



6 < 1 / ( 1+a ) 



and 
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1-3 



*e,e' (s,t) 2 l-(l-a 



(1-a) 6 t E,E 



t (s,t) 



1-2 



1-3 

l-(l-a)3 



[4> e e i (s,(l-a)3t) + <}> E E , ( (1-a) s , t) ] , 



3 > 1/ (1+a) . 



( 6 . 10 ) 



The joint Laplace-Stieltj es transform of the distribution of (E,E') in 
the antithetic case is given, with U a uniform (0,1) random variable, by 

1 

E E ,(s,t) = E{exp [s log U + t log (1-U) ] } = / u S (l-u) t du (6.11) 

u=0 

which is a Beta function. 

Both regressions from (X ,X ., ) of the NEARA(l) model are non- 

n n-1 

linear; directly from the model equations (2.8), the forward conditional 
expectation is 

E (X |X = x) = (l-a3)X _1 + agE(X' Jx = x) . (6.12) 

n n-1 n-1 n-1 

The regression on the right-hand side is complicated but can be obtained 
in the 8 = 1 TEARA(l) case. With positive dependency only, (6.12) 
applies for the NEAR(l) with formally = X^_^, and so there is linear 

regression in this case with 

E(X J X n-l = x) = (l-oc3) A _1 + a3x. (6.13) 



7. THE (X ,X ) JOINT DISTRIBUTIONS; THE Z fx , SUM DISTRIBUTIONS 
n n-r 1 n-1 

These distributions follow directly from the basic expressions (3.3) 

and (3.4) where X is expressed in terms of X or X 1 Expecta- 

n n-r n-r 

tions are taken over the independent V , V 1 , . . . in turn, with the 

n n-1 

following results 
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<f> (s,t) = E{exp(-sX - tx )} 

X , x n n-r 

n n-r 



r-1 

= </ n <f> (B 1 S) 

i=0 e 



<t>X x» (t.fTs) r °dd 



4>^(B r s+t) 



r even 



r-1 . j 

+ l a J (l-a) n « (3 1 s) * Y (t). (7.1) 

j=0 i=0 e X 



In the 3=1, TEARA(l) case, there is the more explicit expression, 



<t>X x (s,t) = ot r [cJ> E ( (1-a) s} ] r 

n * n-r 



X,X 



, (s , t) r odd 



4> X ( s + t) r even 



1 - [a<(>_{ (1-a) s} ] r 



+ (1-a) (l-a)s) 4> ( t ) -r—r n S T • 

E X 1 - acf) { (l-a)sj 



(7.2) 



In Section 8 these expressions are used to derive the autocorrelations 
of the sequence after transformation to a uniform (0,1) marginal distri- 
bution . 

r 

The distribution of the suras E . X . can in principle be 

1=1 n-i 

obtained from the expressions (3.3) and (3.4) in a similar way; for instance, 



X + X = e + X . + gV X' 
n n-1 n n-1 n n-1 



(7.3) 



X+X + X =e+e +6Ve'+(l+6 2 V'V)X _ + BV X' . 

n n-1 n-2 n n-1 n n-1 n-1 n n-2 n n-2 



(7.4) 



Generating functions for these two sums can be written down, but the results 
get progressively more complicated. There does not appear to be any simple 
general result, even with the NEAR(l) model. 
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8. RUN PROBABILITIES AND A PARTIALLY REVERSIBLE PROCESS, PREAR(l) 

We have already indicated in Figures la, lb, lc that the sample path 
behavior of NEAR(l) processes can be distinctive, and is adjustable through 
the two parameters a and (3. This distinctive behavior makes the model 

very rich and is principally observed as runs of increasing values (up-runs) 
or runs of decreasing values (down-runs) or both (peaks) . Such 
behavior is not possible with Gaussian AR(1) models. In the discussion 
which follows we will explain the parameterization of the process 

illustrated in Figure lc, which exhibits a partial time reversibility. 

A simple quantification of sample path behavior is given by 

P(X < X -), which is related to the average length of up-run sequences, 
n n-1 

Calculation of P(X < X ) follows from (2.3) as 



n 



n-1 



P (X < X J = (1-a) P(X - > e ) 4- aP(X n > e + 3X J 
n n-1 n-1 n n-1 n n-1 



= (l-a) P(X > e ) + (1-a) P (X > e / (1-3) ) . 
n-1 n n-1 n 



( 8 . 1 ) 



By using the definition of given at (2.6) and the independence of 

X^_^ and the probabilities in (8.1) are easily calculated and give 




1 



( 8 . 2 ) 



l-(l-a)8 



l+U-B) 



1-f- ( 1-3 ) 1 (l-a)8 



(1-a) (1+8 ) a (1-8 ) 

2 [l+(l-a)8 ] (2-a)(l-aB) ' 



(8.3) 
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For the TEAR(l) process this probability (with 8 = 1) reduces to 

(l-a)/(2-a) and is thus always less than one-half, so indicating an 

excess of up-runs; this is clearly illustrated in Figure lb, A grid of 

values of this probability for a, 3 = 0.0(0. 1)1.0 is given in Table 2. 

The asymmetry of up-run and down-run sequences for most NEAR(l) 

processes is evidence enough of their irreversibility in time. The value 

of P (X < X , ) and its difference from one-half gives one measure of this 
n n-1 

another possible measure could be based on the difference between the 

2 2 

directional correlations Corr(X , X - ) and Corr(X , X from 

n n-1 n n-1 

(2.3) these may straightforwardly be obtained as 



The equality of these two correlations suggests one definition of partial 

reversibility, and for NEAR(l) processes gives the condition 8 = l/(2-a) . 

The simulations in Figure lc are for this parametrization . Another 

partial characterization of time reversibility would simply be that 

P(X^ < X^_^) = 1/2; surprisingly, for NEAR(l) processes, this second 

definition also leads to the condition 8=1/ (2-a) . Hence we shall 

refer to the NEAR(l) process with 8 = 1/ (2-a) as the partially reversible 

or PREAR(l) process. It is not fully reversible, even as far as the 

joint distribution of (X , X ,) is concerned, but it seems somewhat 

n n-1 

remarkable that it is reversible in both the run-probability and 
directional-correlation aspects. 



Corr(X , X 2 .) = aB 



n’ n-1 



(8.4) 




(8.5) 
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9. TRANSFORMATION TO A MULTIPLICATIVE PROCESS WITH UNIFORM MARGINALS 

One useful aspect of exponential processes is that they provide a 

suitable base from which to transform to other processes of positive variables; 

they are particularly convenient for transforming to a multiplicative 

uniform process; thus the transformed process {expC-XX^)} is now considered, 

with derivations of the autocorrelations and autoregressions. 

When X has an exponential marginal distribution with parameter X, 
n 

the variable U = exp(-AX ) has a uniform (0,1) marginal distribution, 
n n 

The autocorrelations of the (U^l sequence are easily obtained from the 
joint Laplace-Stielt jes transform of the joint distribution of (X^, X^ ); 
thus 

Corr (U , U ) = {E(U U ) - 1/4} / (1/12) 
n n-r n n-r 



= 12E{exp[-X(X + X ) ]} - 3 
n n-r 

= 12<f> x x (A , A) - 3 . (9.1) 

n ’ n-r 



Working from (7.1) a reasonably explicit result for (9.1) is 
obtained; the first expression to be considered is 



r-1 

12a r n <f> (B 1 X) , 
i=0 



where 



<p (s) is given by (2.5). After some cancellations, we get 



12a 



r 



r-1 

n 

i=0 



i> (6 1 X) = 6a r (l+g r ) 
e 



n U + (l-a)e 1 } 1 

i=l 



(9.2) 
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The second term of (7.1) and (9.1) is 



r-1 

I2(l-a) ^ 

j=o 



j 

n 

1=0 



<t> e (B 1 ^) 4> X (A) - 3 



= 3(l-a) 



T a j (l+B j+1 ) 

3=0 



n (1 + (l-a)6 1+1 } _1 
i=0 



3 . 



(9.3) 



This does not look promising, at least not until the j = 0 term is taken 
out and combined with the -3; the expression then becomes 



3(l-a) 



T a j (l + 6 0 +1 ) 

3 = 1 



n U + (l-a)6 1+1 } 1 - 3a (1 + (l-o)B) 1 
i=0 



Next the term j=l is taken out and combined with the last term; this 
yields 



3 (1-a) 



l a j u + e j+1 ) 
3=2 



n (1+ (l-a)B 1+1 }" 1 
i-0 



3a 2 n {1 + (l-a)B 1+1 } 1 
i=0 



Continuing in this fashion gives the final expression 



i=l 



(1 + (l-a)B 1 ) 1 



Bringing together (9.1), (7.1), (9.2) and (9.4) gives 
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Corr (U ,U ) = 

n n-r 



6a r (14£ r ) 



4> x x* ^ r even 
1 / ( 2H-6 r ) r odd 



-3a 



r 



r * -l 

n {l-f(l-a)8 1 } 
i=l 



3{2(l-H3 r H (X,f3 r A)-l} n ( r 

X,X i=l ' l+(l-a)8 1 

— - — n ( 

. 2+6 r i=l V l+(l-a)B 1 / 



(r odd) 



(9.5) 



(r even) . 



This is the required result; it is computationally explicit in several 
cases: the 8 = 1 TEARA(l) model, the NEARA(l) model for 0 _< a 1/2 

and the NEAR(l) model for the full parameters region. This latter model 
has as its transformed autocorrelation function 



Corr (U 

n 



U 

n-r 



) = 




" (-*-?) 
i=l ' l+(l-a)6 / 



r = 1,2,... (9.6) 



The only case of (9.5) which is not available in closed form is the 

NEARA(l) model for 1/2 _< a _< 1 . The series expansion from (6.7) for 

(f) ,(X,8 X) would require detailed examination; the lower bound of the 

X , X 

r=l case would be interesting. 

We now derive the forward regression E(U |U _) of the variables 

n n-1 

in this uniform process; it has previously been remarked, equation (6.13), 
that for exponential NEAR(l) variables this is linear. As for the auto- 
correlations of transformed exponential processes, equation (9.1), a 
a general result is available. Without going into details, this can be 
written 

E [exp(-AX ) I X = x]* = A 1 <t> (A,s-A) , (9.7) 

n n 1 X , x _ 

n n-1 



where asterisk denotes Laplace-Stieltjes transform with respect to x 
of argument s. Inversion in the NEAR(l) case gives the desired result 
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(9.8) 




/I B N 

(1 - a + a u ) . 



As to be expected it is non-linear. The corresponding backward regression 
is also available from (9.7). 



apply here since the transformation used is monotonic; in particular the 
uniform process is reversible in its run behavior under the condition 
3 = l/(2-a). However, reversibility of the directional correlations will 
not be achieved under this condition. The directional correlations can 
be obtained by similar methods to those used to obtain the ordinary 
correlations . 

10. ASPECTS OF ESTIMATION 

Formal methods of estimation are rather intractable with the NEAR(l) 
models: as an illustration, in the NEAR(l) case with just one observation 

after the initial value x^, the likelihood takes the form 



where f ( . ) is the mixed exponential pdf of the independent £ 
variables given at (2.6). With more observations, the full likelihood 
becomes, in view of the first order Markov structure of this 
model, the product of similar terms. The maximization 
needs to be done numerically and because of singularities 



Finally, we note that the results from Section 8 on run behavior 



af^Cx^BXg) , 6 < ^/xq , 



L(oi,B;x^,Xq) = (1-a) f £ (xp + 



( 10 . 1 ) 



0 



6 > x / Xq , 
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in the parameter space, the standard asymptotic theory of maximum likeli- 
hood is inapplicable. A discussion of the problems in the a = B 

case of the NEAR(l) model is given by Raftery (1979) . When a = 1 the 
estimator proposed in Gavar and Lewis (1980) is the maximum likelihood 
estimate (personal communcation from G. Weiss). In this- section we limit 
ourselves to ad hoc possibilities for estimation when a ^ 1. 

The method of moments can be developed for the NEAR(l) model: use 

can be made of the directional correlations (8.4) and (8.5). The 
product a B in (8.4) is best estimated by the first serial correlation, 
rather than the sample directional coorelations . Then using the sample 
directional correlation based on (8.4) an estimate of B can be obtained 
and hence an estimate of a. Methods of improving the efficiency of these 
moment estimates are being studied. Use of the run probability given by 
(8.3) is also a possible tool for estimation. 

11. FURTHER DEVELOPMENTS 

Further work on this topic is being directed at the estimation, 
simulation and sample path aspects. Extensions of the model to mixed 
exponential variables are also being developed. 
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TABLE 2. PROBABILITY THAT X IS LESS THAN X_ n FOR THE NEAR(l) MODEL AS A FUNCTION OF 
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NEAR ( 1 ) PROCESS— EAR(l) CASE 
ALPHA = .990, RHO =0,75 

BETA = . 758 




FIGURE la. Simulated sample path for the EAR(l) process of Gaver and Lewis (1980) 
which is the special case NEAR(l) process in which a = 1.0. (Simulation 
done with a = .99 to avoid computation problems.) For this case 
P{X^ < = *78 and the runs of falling values are clearly 

discernible . 
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NEAR ( 1 ) PROCESS— TEAR(l) CASE 
ALPHA = • 758, RHO = 0.75 

BETA = .990 
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Figure lb. Simulated sample path for the TEAR(l) process, the special case 
NEAR(l) process in which 6=1. (Simulation done with 6 = .99 
to avoid computational problems.) For this case P{X^ < = 0 
and the predominance of runs of ascending values is clearly 
discernible . 
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NEAR ( 1 ) PROCESS— PREAR(l) CASE 
ALPHA = • 857, rho = 0.75 

BETA = .875 




100 

Figure lc . Simulated sample path for the NEAR(l) process which is partially 

time-reversible in that the directional correlations are equal and 
= 1/2. The parametrization for this PREAR(l) process 
is 6 = l/(2-a). Note that the same i.i.d. exponential sequence 



(E n ) was used in the three simulations of Figures la, lb, lc. 
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NEARA(l) PROCESS-TEARA(l) CASE 



ALPHA =0.75 
BETA = 0.990 




Figure Id. Simulated sample path for the TEARA(l) process, the special 
case NEARA(l) process in which B = 1. (Simulations done 
with B = 0.99 to avoid computational problems.) Runs of 
alternating ascending values can be discerned, and are produced 
by the negative dependency in the model; this compares with 
the smoother run-up sequences in the TEAR(l) simulation of 

Fig. lb. 
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